<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta http-equiv="Content-Type"
 content="text/html; charset=windows-1252">
  <meta content="PHP Coder Pro" name="Generator">
  <title>Horizon Chess</title>
</head>
<body bgcolor="#f0f0f0" link="#0000ff" vlink="#800080">
<font face="Verdana">
<h2 align="center">Jim's Page</h2>
</font>
<font face="Verdana">
<h4 align="center">&nbsp;</h4>
</font><b><font face="Helvetica,Arial" size="6">
<p align="center">Chess IQ Test, Version 5</p>
</font></b><font face="Courier New" size="2">
<p align="center">by Jim Monaghan</p>
</font><font size="2"></font>
<p align="center"><font size="2">&nbsp;</font></p>
<p><font size="2">&nbsp;</font><a href="iq5.zip"><font size="2">Download
the IQ5 Test</font></a></p>
<font size="2">
<p>&nbsp;</p>
</font><font face="Helvetica,Arial">
<h4>Tactical IQ5 Test for Chess Programs</h4>
</font><font face="Helvetica,Arial" size="2">
<p>This test is based on a test suite from the master section of
Livshits' book
"Test Your Chess IQ". It has been debugged and improved. The positions
are
carefully balanced with medium to hard examples. The test as presented
here is
intended to estimate the tactical strength of chess engines. The
scoring is
approximate and not intended to be too serious.
</p>
Changes:
IQ to IQ2:
<ul>
  <li>I dropped 131 "easy" positions solvable in 4 ply or less</li>
  <li>I dropped 16 "hard" positions requiring 12 ply or more</li>
  <li>I dropped 12 "avoid move" positions due to their negative focus
Resulted in 360 positions down to 201.</li>
</ul>
IQ2 to IQ3:
<ul>
  <li>Andreas Hermann pointed out 6 duplicate positions. Resulted in
201 down to 195.</li>
</ul>
IQ3 to IQ4:
<ul>
  <li>Jon Dart pointed identified 7 problematical positions. Resulted
in 195 down to 188.</li>
</ul>
IQ5
<ul>
  <li>Puzzles increased from 188 to 191. Three 12+ ply puzzles added
back in. Thanks to Dann Corbit, Kurt Utzinger, and Uri Blass for
analysis. Scoring method changed to reflect current puzzle book trends.
Time is not emphasized now, but rather the difficulty of the puzzle is
rated and scored accordingly. </li>
</ul>
<p>The test as presented here is intended to estimate the tactical
strength of chess engines. The test duration is 31 minutes and 20
seconds. Run the test on a chess engine at 10 seconds per position,
note the percentage score achieved and calculate the engine's IQ4
score:
</p>
<p></p>
</font><b><font face="Arial" size="2">
</font><font face="Helvetica,Arial">
<h4>IQ5 scoring</h4>
</font><font face="Helvetica,Arial" size="2"></font></b>
<p></p>
<pre><font face="Helvetica,Arial" size="2">Ply Depth    # of puzzles    Score Value     Max Possible<br>    5             47              2.5             117.5<br>    6             45              3.0             135.0<br>    7             39              3.5             136.5<br>    8             19              4.0              76.0<br>    9             17              4.5              76.5<br>   10             15              5.0              75.0<br>   11              6              5.5              33.0<br>   12+             3              6.0              18.0<br>                                                  _____<br>                                  Total           667.5<br></font></pre>
<p></p>
<p><font face="Helvetica,Arial" size="2">Elo range for the test is 1995
to 2663.</font></p>
<p><font face="Helvetica,Arial" size="2">There is now no time limit for
the test as opposed to the old standard of 10
seconds per position which seemed rather artifical. Simply test an
engine
and include the PC processor details (speed, hash, etc.) and time
taken. You
might want to split the test up by ply and run them seperately to score
the
test easier.</font></p>
<p><font face="Helvetica,Arial" size="2">The new formula is:</font></p>
<p><font face="Helvetica,Arial" size="2">IQ5 elo = 1995 + 2.5(5s) +
3.0(6s) + 3.5(7s) + 4.0(8s) + 4.5(9s) + 5.0(10s)
+ 5.5(11s) + 6.0(12s)</font></p>
<p><font face="Helvetica,Arial" size="2">Where (5s) for instance means
the number of ply 5 positions scored correctly
and so on. Note point value of a puzzle is half the ply depth.</font></p>
<font face="Helvetica,Arial">
<h4>Information and Improvements</h4>
</font><font face="Helvetica,Arial" size="2">
</font>
<p><font face="Helvetica,Arial" size="2">If you run the test and would
like to share your results please send them along.
If you find any alternative solutions or questionable ones please send
this data
so the test can be improved. My thanks to the posters at CCC and the WB
forum
for pointing out errors and omissions. Enjoy the test.
</font></p>
<p><font face="Helvetica,Arial" size="2">&nbsp;</font></p>
</body>
</html>
